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ABSTRACT 


J 

This  study  investigated  the  application  of  multidimensional  scaling  methods 

I  '  ^  A.'  ‘  ^  ‘  / 

in  the  area  of  job  performance^  Supervisory  personnel  judged  the  similarity 
among  all  pairs  of  29  tasks  which  had  been  designated  as  constituting  the  job  of  the 
Naval  aviation  electronics  technician  supervisor.  The  resulting  scaled  similarity 
estimates  were  analyzed  by  multidimensional  scaling  techniques. 

This  research  supplemented  an  earlier  study  by  providing  further  evidence 
that  it  is  feasible  and  fruitful  to  apply  multidimensional  scaling  methods  to  Naval 
job  performance.  Chief  petty  officers  and  petty  officers,  first  class,  in  the 
aviation  electronics  technician  rating  perceived  their  work  as  involving  nine  basic 
dimensions,  including  all  the  dimensions  underlying  the  job  of  strikers  and  petty 
officers,  third  class,  in  the  rating. 
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CHAPTER  I 


INTRODUCTION 

Recent  research  carried  out  by  Applied  Psychological  Services  in  the  area 
of  criterion  development  hao  emphasized  the  application  of  psychological  scaling 
methodology  to  job  performance  measurement.  Earlier  studies  had  produced  com 
prehensive,  detailed  check  lists  for  evaluating  the  post-training  job  performance  ( 
Naval  enlisted  personnel  in  several  technical  specialties.  Psychological  scaling 
techniques  appeared  to  offer  promise  as  a  means  for  constructing  short,  conven¬ 
ient- to- use  instruments  and  for  obtaining  further  insight  into  the  basic  structure  o 
the  job.  The  first  efforts  along  these  lines  (Schultz  and  Siegel,  1961;  Siegel  and 
Schultz,  1962)  examined  the  applicability  of  the  Thurstone  and  Guttman  scaling 
methods  in  performance  criterion  development. 

The  most  recent  report  (Schultz  and  Siegel,  1962)  described  a  multi¬ 
dimensional  scaling  analysis  of  the  job  performance  of  Naval  aviation  electronics 
technicians.  In  that  report  it  was  pointed  out  that  job  criteria  have  generally  beer 
found  to  be  complex  and  multidimensional  but  that  this  problem  area  required 
further  quantitative  consideration  and  methodological  exploration.  In  these  respe< 
multidimensional  scaling  analysis  seemed  particularly  appropriate,  since  its  pri¬ 
mary  purpose  is  to  determine  the  number  and  characteristics  of  the  dimensions 
underlying  the  phenomenon  which  is  being  analyzed. 
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Although  multidimensional  scaling  methods  differ  from  unidimensional 
scaling  methods  in  that  the  scales  or  dimensions  are  not  defined  for  the  judges  by 
the  experimenter,  essentially  they  represent  an  extension  of  the  traditional  psy¬ 
chophysical  scaling  methods.  Richardson  (1938)  was  the  first  person  to  use  multi¬ 
dimensional  scaling;  more  recently  the  methods  have  been  developed  by  a  number 
of  research  workers  and  applied  in  a  variety  of  situations. 

Torgerson  (1952,  1958),  Messick  (1956a,  1956b),  and  others  have  given 
the  details  of  the  derivative  and  computational  procedures  used  in  multidimensiona 
scaling  analysis.  Its  essential  rationale  and  some  of  the  technical  issues  involved 
were  discussed  in  the  previous  Schultz  and  Siegel  report  (1962).  In  brief,  the 
structure  of  multidimensional  scaling  rests  upon  estimates  of  the  psychological 
distances  among  the  stimuli  being  studied.  These  have  usually  been  obtained  on 
the  basis  of  judgments,  by  appropriate  subjects,  of  the  over-all  similarity  betweer 
each  stimulus  pair  included  in  the  phenomenal  descriptive  constellation.  The  scab 
values  resulting  from  these  judgments  are  then  taken  as  measures  of  the  inter¬ 
stimulus  distances  in  a  Euclidean  space  and  the  central  analytical  problem  become 
first,  the  determination  of  the  number  of  axes,  or  dimensions,  in  the  space  and, 
second,  the  projections  of  the  stimuli  on  the  axes. 

In  the  first  application  of  multidimensional  scaling  techniques  to  the  Naval 
job  performance  area  (Schultz  and  Siegel,  1962),  18  tasks  constituting  the  typical 
work  performed  by  Naval  aviation  electronics  technicians  at  the  striker  and  petty 
officer,  third  class,  level  were  analyzed.  The  job  perceptions  of  supervisory 
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personnel  in  that  rating  formed  the  data  substrate.  Four  basic  job  dimensions 
emerged  from  the  analysis.  The  matrix  of  task  loadings  on  the  various  dimen¬ 
sions  suggested  the  names  "electro-comprehension,  "  "equipment  operation  and 
inspection  (routine),  "  "electro-repair  (simple),  "  and  "electro-safety"  for  the 
four  dimensions.  It  was  felt  that  these  dimensions  described  the  technical  job 
activities  of  the  aviation  electronics  technician  striker  and  petty  officer,  third 
class,  adequately  and  meaningfully.  Furthermore,  it  was  concluded  that  the 
four  dimensions  possess  characteristics  such  that  it  should  be  possible  to  devel¬ 
op  unidimensional  scales  for  the  evaluation  of  individuals  on  each  isolated  and 
identified  dimension. 

The  first  study  further  indicated  that  it  is  feasible  and  fruitful  to  apply 
multidimensional  scaling  techniques  to  a  job  task  constellation.  In  order  to  pro¬ 
vide  a  firmer  empirical  base  for  the  acceptance  or  rejection  of  this  conclusion, 
application  of  the  procedures  to  another  set  of  job -task  stimuli  seemed  desirable 
For  this  purpose,  attention  was  directed  to  the  manner  in  which  chief  petty  of¬ 
ficers  and  petty  officers,  first  class,  in  the  Naval  aviation  electronics  techni¬ 
cian  rating  view  their  own  job.  The  results  of  such  a  study  would  also  permit  a 
comparison,  from  the  point  of  view  of  supervisory  personnel,  of  the  job  dimen¬ 
sional  characteristics  at  the  supervisory  and  the  journeyman*  levels  of  aviation 

♦  Throughout  this  report  the  term  "journeyman"  is  used  to  refer  to  a  striker  or 
a  petty  officer,  third  class,  in  the  rating.  The  term  "supervisor"  refers  to  a 
chief  petty  officer  or  a  petty  officer,  first  class. 
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electronics  technicians  and  thus  throw  light  on  the  basic  structure  of  the  rating 
as  a  whole. 

Purposes  of  the  Present  Study 

The  specific  purposes  of  the  present  study  paralleled  those  of  the  first 
application  of  multidimensional  scaling  techniques  in  the  job  performance  area 
(Schultz  and  Siegel,  1962),  They  were  to:  (1)  explore  further  the  feasibility  of 
applying  standard  multidimensional  scaling  procedures  to  a  job  task  constellation, 
(2)  investigate  more  fully  specific  methods  for  applying  these  techniques  in  the 
work  oriented  situation,  and  (3)  determine  the  number  and  the  nature  of  the  dimen* 
sions  of  the  job  of  the  Naval  aviation  electronics  technician  supervisor,  A  fourth 
purpose  was  to  compare  the  dimensional  structure  of  the  aviation  electronics 
technician  job  at  the  supervisory  and  the  journeyman  levels. 
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CHAPTER  II 


DEVELOPMENT  AND  ADMINISTRATION  OF  TASK  UST 

Since  the  study  presented  here  was  very  similar  in  purpose  to  the  previous 
Applied  Psychological  Services*  investigation  into  the  aviation  electronics  techni- 
cian*s  job  (Schultz  and  Siegel,  1962),  some  of  the  preliminary  work  for  both  pro¬ 
grams  was  carried  out  in  parallel  and  there  was  overlap  in  content  and  style 
between  the  data  collection  forms  used.  Therefore,  to  make  this  description  com 
plete  some  material  from  the  previous  report  is  reviewed  in  this  chapter. 

Preliminary  List  of  Tasks 

In  order  to  provide  the  "raw  material"  for  the  multidimensional  analysis, 
it  was  necessary  to  derive  a  list  of  tasks  which  could  be  said  to  constitute' the  job 
of  chief  petty  officer  and  petty  officer,  first  class,  in  the  Naval  aviation  electroni< 
technician  (AT)  rating.  The  tasks  were  to  be  stated  in  behaviorally  oriented  term 
with  sufficient  detail  to  reflect  adequately  the  work  performed,  yet  with  sufficient 
generality  to  make  feasible  the  required  similarity  judgments.  In  addition, 
reference  to  specific  equipment  was  to  be  avoided  so  that  neither  general  nor 
specific  "equipment"  factors  would  be  generated. 

A  preliminary  list  was  developed,  based  largely  on  three  previous  Applied 
Psychological  Services'  studies  of  aviation  electronics  technicians  (Richlin,  Siege 
and  Schultz,  1960;  Schultz  and  Siegel,  1961;  Siegel  and  Schultz,  1962).  Since  thos 
studies  had  concentrated  on  journeyman  level  personnel  it  was  necessary  to 
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supplement  the  list  with  tasks  that  were  thought,  from  Applied  Psychological 
Services*  background  in  the  field,  to  be  performed  by  AT  supervisors  but  not  by 
the  lower  level  personnel.  The  complete  preliminary  list  of  40  tasks  has  been 
presented  in  the  previous  report  by  Schultz  and  Siegel  (1962). 

Final  Selection  of  Job  Tasks 

The  40  tasks  were  assembled  in  booklet  form.  The  booklet  was  adminis¬ 
tered,  in  two  groups,  to  23  instructors  in  the  AT  school  at  the  Naval  Air  Technics 
Training  Command  in  Memphis,  Tennessee.  It  could  be  assumed  that  these  men 
knew  the  job  under  consideration  since  they  were  chief  petty  officers  or  petty 
officers,  first  or  second  class,  in  the  AT  rating  and  all  had  recently  arrived  at  th 
school  from  Fleet  duty.  On  the  average,  the  instructors  had  about  7-1/2  years  of 
military  experience  in  electronics  or  electrical  work,  had  about  5-1/2  years 
experience  as  an  AT  and  had  been  assigned  as  an  AT  to  about  2-1/4  different 
squadrons  during  their  careers. 

On  the  cover  page,  the  booklet  gave  the  following  explanation  of  purpose 
and  directions: 

The  purpose  of  this  questionnaire  is  to  determine 
the  specific  tasks  AT*s  perform  in  the  Fleet.  We  want  to 
obtain  a  list  of  the  jobs  done  by  a  representative  sailor  in 
this  rating. 

First,  look  over  the  list  to  get  an  idea  of  what  tasks 
are  included.  Then: 


1.  Go  through  the  list  and  check  in  the 
column  labeled  '*AT  Strikcr/3rd  Cl.  ** 
all  the  tasks  which  arc  normally  and 
customarily  performed  by  Striker  and 
Third  Class  AT^s  in  the  Fleet. 

2,  Go  back  and  place  a  check  in  the  second 
column  next  to  all  the  tasks  which  are 
normally  and  customarily  performed  by 
First  Class  and  Chief  AT*s  in  the  Fleet. 

You  may  know  of  a  particular  sailor  who  has  done  some 
of  the  listed  tasks,  even  though  most  AT's  do  not  do  them.  Or, 
in  a  particular  squadron  with  which  you  are  familiar,  the  AT*s 
may  perform  certain  duties  not  normally  performed  by  most  of 
the  men  in  the  rating. 

The  administrator  emphasized  that  such  tasks  were  not  to  be  checked. 

The  directions  concluded, 

If  there  are  any  tasks  normally  performed  by  AT’s  in 
the  Fleet  which  are  not  included  in  the  questionnaire,  please 
write  them  in  under  "Other''  on  the  last  page.  Be  sure  to  check 
whether  these  tasks  are  done  by  Strikers  and  Third  Class  men 
or  by  First  Class  men  and  Chiefs  or  by  both. 

This  final  instruction  permitted  the  addition  of  any  important  AT  activities  which 

had  been  omitted  inadvertently  from  the  initial  group  of  40  tasks. 

Before  the  men  began  working  on  the  booklets,  the  administrator  again 
stressed  the  point  that  a  complete  picture  of  the  job  as  it  is  actually  performed 
was  wanted,  rather  than  as  it  is  supposed  to  be  performed  according  to  any 
criterion  whatsoever.  After  the  men  had  finished  the  form,  an  informal  dis¬ 
cussion  was  held  to  determine  their  estimate  of  the  over-all  completeness  of  the 
list  and  to  obtain  suggestions  about  such  matters  as  the  wording  of  the  tasks. 
From  the  comments  made  during  these  sessions,  it  appeared  that  there  was 
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general  agreement  among  these  "experts"  that  their  responses  reflected  the  work 
done  by  AT's  in  the  Fleet  accurately  and  adequately. 

The  instructors  added  no  significantly  new  tasks  in  the  spaces  provided 
for  "other"  tasks.  The  consensus  clearly  indicated  29  of  the  40  tasks  as  consti¬ 
tuting  the  AT  job  at  the  chief  petty  officer  and  petty  officer,  first  class,  level. 

The  other  items  were  checked  with  var3ring  frequencies  but  19  or  more  of  the 
judges  agreed  that  the  29  tasks  were  performed  by  AT  supervisors.  These  data, 
therefore,  strongly  supported  the  conclusion  that  the  AT  supervisory  job  was  per¬ 
ceived  by  these  widely  experienced  men  as  comprising  the  29  tasks  they  had  checkc 
The  following  29  tasks,  therefore,  formed  the  basis  for  the  multidimensional  scalii 
analysis  of  the  job  performance  of  Naval  aviation  electronics  technician  supervisor 

1.  Standing  watch 

2.  Performing  major  inspections  of  avionic  equipments 

3.  Operating  avionic  equipments 

4.  Using  safety  precautions  on  equipment 

5.  Using  proper  safety  precautions  for  self 

6.  Performing  inflight  maintenance  on  avionic  equipments 

7.  Repairing  malfunctioning  parts/ equipment  in  shop 

8.  Following  block  diagrams  for  avionic  equipments 

9.  Using  schematics  for  standard  circuits  in  avionic 
equipments 

10.  Using  schematics  for  complex  circuits  in  avionic 
equipments 
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11.  Analyzing  standard  circuitry  in  avionic  equipments 

12.  Analyzing  complex  circuitry  in  avionic  equipments 

13.  Troubleshooting/ isolating  malfunctions  in  avionic 
equipments 

14.  Making  out  reports  (failure,  etc. ) 

15.  Using  maintenance  manuals 

16.  Using  inspection  and  operation  manuals 

17.  Operating  standard  test  equipment  for  determining 
malfunctions  in  avionic  equipments 

18.  Operating  specialized  test  equipment  for  determining 
malfunctions  in  avionic  equipments 

19.  Using  ASO  catalog  and  Section  R  allowance  list  for 
replacement  parts 

20.  Employing  electronic  principles  involved  in  the 
maintenance  of  avionic  equipments 

21.  Knowing  relationship  to  other  related  equipment  of 
avionic  equipments 

22.  Instructing  others  in  the  operation  of  avionic  equipments 

23.  Instructing  others  in  the  inspection  of  aviomc  equip¬ 
ments 

24.  Instructing  others  in  the  maintenance  of  avionic  equip¬ 
ments 

25.  Supervising  operation  of  avionic  equipments 

26.  Supervising  inspection  of  avionic  equipments 

27.  Supervising  maintenance  of  avionic  equipments 

28.  Keeping  record  of  maintenance  usage  data 

29.  Assigning  duties  to  personnel 


A  comparison  of  the  above  list  with  the  analogous  list  from  the  journey¬ 
man  level  analysis  reveals  that  nine  tasks  were  included  in  both  lists.  These 
tasks,  which  are  performed  by  both  supervisors  and  journeymen  in  the  AT  rating, 
according  to  the  judges,  are:  standing  watch,  operating  avionic  equipments,  using 
safety  precautions  on  equipment,  using  proper  safety  precautions  for  self,  follow¬ 
ing  block  diagrams  for  avionic  equipments,  using  schematics  for  standard  circuits 
in  avionic  equipments, making  out  reports  (failure,  etc.  using  inspection  and 
operation  manuals,  and  operating  standard  test  equipment  for  determining  mal¬ 
functions  in  avionic  equipments.  The  tasks  done  only  by  the  strikers  and  petty 
officers,  third  class,  involve  the  simpler  duties  such  as  "housekeeping"  chores, 
routine  line  operations,  routine  inspections,  removal  and  replacement,  and 
preventative  maintenance.  On  the  other  hand,  the  chief  petty  officers  and  petty 
officers,  first  class,  carry  out  a  variety  of  more  complex  activities  such  as  majoi 
inspections,  troubleshooting  and  repair,  operating  test  equipment,  using  schemati 
and  analyzing  circuitry,  as  well  as  administrative  duties  such  as  supervising, 
instructing,  keeping  records  and  assigning  duties. 

The  Multidimensional  Scaling  Form 

The  29  tasks  designated  as  comprising  the  AT  supervisory  job  were 
arranged  in  a  booklet,  called  Form  C  of  the  Technical  Task  Inventory,  so  that 
estimates  of  the  similarity  between  each  pair  of  tasks  could  be  obtained,  in  group 
administrations,  from  judges.  At  the  top  of  each  page,  1  of  the  29  tasks  was 
shown.  Below  it  at  the  left  side  of  the  page,  from  1  to  all  (28)  of  the  remaining 
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tasks  were  listed.  Since  the  psychological  distance  between  each  pair  of  tasks 
was  judged  in  only  one  direction,  i.  e. ,  from  task  A  to  task  B  and  not  from  task 
B  to  task  A,  it  was  not  necessary  to  show  a  task  on  later  pages  after  it  had  been 
used  at  the  top  of  a  page.  The  tasks  on  any  page  were  listed  in  a  random  order 
which  was  varied  from  one  page  to  another. 

To  the  right  of  each  item  there  appeared  a  scale  running  from  1  to  11. 

The  scale  points  1  and  2  were  described  as  representing  a  judgment  of  "very 
similar";  points  3,  4,  and  5,  as  representing  "moderately  similar";  points  7,  8, 
and  9,  as  representing  "moderately  different";  and  points  10  and  11,  as  repre¬ 
senting  "very  different."  Scale  point  6,  in  the  middle  of  the  range,  was  unlabeled. 
The  booklet  page  which  contained  all  the  tasks  is  shown  as  Table  1;  a  sample  of  the 
other  pages  is  shown  in  Table  2. 

The  directions  asked  the  subject  to  compare  each  task  listed  with  the  one 
shown  at  the  top  of  the  page  and  then  to  "indicate  by  a  check  in  the  appropriate 
column  to  the  right  how  similar  or  different  the  two  tasks  are.  "  After  three 
illustrative  responses,  two  comparisons  were  presented  for  respondent  practice. 
The  complete  cover  page  of  the  form,  including  the  directions,  is  shown  in  Table 
3. 

The  order  of  the  pages  in  the  booklet  was  determined  from  a  table  of 
random  numbers,  so  the  number  of  tasks  listed  from  one  page  to  the  next  could 
differ  markedly.  Four  different  random  page  orders  were  used,  the  forms  being 
intermixed  for  administration  to  the  subjects. 
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Table  1 


emteiNe  MACrWCTIONIM  PMTt/WUlWHMT  in 


INtTIIUCTINS  OTHCfie  IN  TMC  NAINTCNANCC 
or  AVIONIC  OQUimCNTt 

INOTAUCTINO  OTMKAt  IN  TNC  INOeCCTION  OF 
AVIONIC  CQUIFMCNTO 

UOINi  OAFCTY  PACCAUTIONO  ON  iquIFMCNT 

FOUOVINO  MjOCK  PIAONANO  FON  AVIONIC 
C^IFNCNTO 

•UrCAVIOINO  NAINTCNANCf  OF  AVIONIC 
IQUIFMCNTO 

KNOVINC  NCtATIONOMlP  OF  AVIONIC 
BQUIFNCNTO  TO  OTHCN  AUATCO  OQUlFNCNT 

fCNFOIIMlNO  INFLIOHT  NAINTCNANCC  ON 
AVIONIC  CqUlFMCNTt 

UOINO  AOO  CATAtOO  AND  OCCTION  A 
AttONANCC  LUT  FON  MCPLACCMCNT  PANTO 

UOINO  INOPCCTION  AND  OPCAATION  NANUALO 

PCNFONNINO  MAJON  INOPCCTIONO  OF  AVIONIC 
CqUiPNCNTO 

MARINO  OUT  RKPONTO  (FAILUNC*  CTC.  ) 

OPCNATINQ  OPACIALIXCD  TCOT  KOUIPMONT  FON 
OCTCNMININO  MALFUNCTIONO  IN  AVIONIC 
tOUiPNCNTO 

UOINO  NAINTCNANCC  IMNUALO 

opcnatino  avionic  OOUIPMCNTO 

ANALVXINO  COMPLCX  CINCUITNV  IN  AVIONIC 
CqUIPMCNTO 

OUFCNVIOINO  OPCAATION  OF  AVIONIC  COUlPMCNTO 

OPCNATINO  OTANOAAO  TCOT  CMIPMCNT  FOA 
OCTCANININO  MALFUNCTIONO  IN  AVIONIC 
CQUIPNCNTO 

OUFCNVIOINO  INOPCCTION  OF  AVIONIC 
OQUIPMCNTO 

ANALV2INO  OTANOAAO  CIACUITAV  IN  AVIONIC 
OQUIPMCNTO 

UOINO  OCHCMATICO  FON  COMPtCX  CIACUITO  IN 
AVIONIC  OQUIPMCNTO 

CMPIOTINO  CLCCTAONIC  PAINCIPLCO  INVOLVCO 
IN  TMC  NAINTCNANCC  OF  AVIONIC  OQUIPMCNTO 

RCCPINO  ACeOOO  OF  NAINTCWMCC  UOaOC  OATA 

INOTAUCTINO  OTNCAO  IN  TMC  OPCAATION  OF 
AVIONIC  CQUIPMINTO 

UOINO  PAOPCA  OAFCTT  PACCAUTIONO  FOA  OCLF 
AOOIONINO  OUTICO  TO  PCAOPNNCL 
01ANOINO  MATCH 

UOINO  OCHCMATICO  FOA  OTANOAAO  CIACUITO  IN 
AVIONIC  OQUIPMCNTO 

TAOUOLCOHOOTINQ/iOOLATINO  MALFUNCTIONO  IN 
AVIONIC  OQUIPIATO 


I 


Sample 


IMtTRUCTIM  OTHCM  IN  TMC  MAINTCNANCC 

or  AVIONIC  iqvirMCNTo 


•UftAVItINQ  MAINTCNANCC  Of  AVIONIC 
CQUimCNTt 

MAKINQ  OUT  ACAOATO  (rAILURCi  CTC.  ) 


UtiNO  tCHCMATiCi  TOR  OTANOAAO  CIRCUITt 
IN  AVIONIC  CqUIfMCNTi 


INtTAUCTINO  OTHCRO  IN  TNC  ORCAATION 
or  AVIONIC  CQUirMCNTI 


CMALOVINO  CLCCTAONIC  rAiNCIPUt  INVOLVCO 
IN  TMC  MAINTCNANCC  Of  AVIONIC  CQUIPMCNTO 

OPCRATINO  OPCeiALIlCO  TCOT  CQUIPMCNT  FOR 
SCTCRMlNINi  MALrUNCTIONA  IN  AVIONIC 
CQUIPMCNTt 


ANALV2INO  OTANOARO  CIRCUITRY  IN  AVIONIC 
CQUIPMCNTt 

PCRFORMiNt  MAMR  INtPCCTIONt  Of  AVIONIC 
CQUIPMCNTt 


INtTRUCTINt  OTHCRt  IN  TMC  INtPCCTION  OF 
AVIONIC  CQUIPMCNTt 


UtiNt  PRORCR  lAFCTY  PRCCAUTIONt  FOR  tCLF 

OPCRATINt  AVIONIC  CQUIPMCNTt 

KCCPINt  RCQORO  OF  MAINTCNANCC  UtAtC  OATA 


tUPCRVItINt  INtPCCTION  OF  AVIONIC 
CQUIPMCNTt 


AttItNiNt  OUTICt  TO  PCRtONNCL 

TROUttCtHOOTINt/liOUTINO  MAWFUNCTIONt 
IN  AVIONIC  CQUIPMCNTt 


UtINt  MAINTCNANCC  MANUAWt 


rOCCOUINt  tLOCR  DIAtRAMt  FOR  AVIONIC 
CQUIPMCNTt 


OPCRATINt  tTANOARO  TCtT  CQUi _ _ 

OCTCRMlNiNt  MALFUNCTIONt  IN  AVIONIC 
CQUIPMCNTt 


I 


Table  2 


e  of  the  Technical  Task  Inventory,  Form  C 
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Table  3 


Cover  Page  of  the  Technical  Task  Inventory,  Form  C 


Form  C 


Today's  Date 


TECHNICAL  TASK  INVENTORY 

The  purpose  of  this  questionnaire  is  to  compare  various  tasks  performed  by  AT's  in 
the  Fleet, 

One  task  is  shown  at  the  top  of  each  page.  Below  it  is  a  list  of  other  tasks.  Beside 
each  task  in  the  list  is  a  scale  running  from  very  similar  to  very  different.  You  should  com¬ 
pare  each  task  in  the  list  with  the  one  at  the  top  of  the  page  and  indicate  by  a  check  in  the 
appropriate  column  to  the  right  how  similar  or  different  the  two  tasks  are.  There  are  no 
"right"  or  "wrong"  answers  to  this  Inventory;  your  best  judgments  of  similarity  are  the  only 
"right"  answers. 

Before  you  begin,  open  the  booklet  and  look  over  the  pa^es  briefly  to  get  an  idea  of 
what  tasks  are  included.  Notice  that  the  pages  have  different  numbers  of  tasks  listed.  Then 
start  working  at  the  beginning  of  the  booklet.  Try  to  vary  your  check  marks  so  that  some 
appear  in  all  eleven  columns.  Do  not  hesitate  to  use  the  extreme  responses  numbered  1  and 
11,  if  you  feel  any  comparison  deserves  one  of  them. 


sjstmsi 


DftlVINQ  AND  OfCRATINQ  NC-^ 


VCAY 
•  IHILAN 


MOOCRATCLY 

SIMILAR 


MOOCRATCLY 
Ot  rrCRCNT 


VERY 

01 rrcRCNT 


rgCLiNQ  PLANES 

TCSTINQ  TUBES 

SOLVINQ  CIRCUIT  EQUATIONS 

fCRFORMINQ  PREFLIOKT  INSPECTIONS  OP 
AVIONIC  EQUIPMENTS 

USINQ  MAINTENANCE  MANUALS 


The  first  check  means  that  the  person  completing  the  Inventory  thinks  that  "fueling 
planes"  is  moderately  similar  (to  the  degree  indicated  by  a  "3")  to  "driving  and  operating  NC-5.  " 
The  second  check  means  that  the  person  answering  feels  that  "testing  tubes"  is  moderately 
similar  (to  the  degree  indicated  by  a  "5"  )  to  "driving  and  operating  NC-5,  "  According  to  the 
check  on  the  third  line,  "solving  circuit  equations"  is  very  different  from  "driving  and  operating 
NC-5.  "  You  may  or  may  not  agree  with  this  person.  Try  filling  in  the  last  two  lines  yourself. 

WHEN  YOU  HAVE  FINISHED.  CHECK  BACK  TO  MAKE  CERTAIN  YOU  HAVE  PLACED  A  CHECK 
NEXT  TO  EACH  TASK  IN  THE  LIST  ON  EVERY  PAGE. 

PREPARED  BY 

APPLIED  PBYCHOLOQICAL  BERVICEt 
WAYNE,  PCNNBYLVANIA 

UNDER  CONTRACT  NONR  2279(00) 


Of PICE  Of  NAVAL  REBEARCH 
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Subjects 


The  subjects  used  in  this  study  were  the  same  as  those  of  the  previouj 
multidimensional  analytic  study.  There  were  31  chief  petty  officers  and  34  petty 
officers,  first  class,  in  the  Naval  aviation  electronics  technician  (AT)  rating.  The 
squadrons  to  which  the  raters  were  assigned  and  their  locations  are  presented  in 
Table  4,  which  is  repeated  from  the  earlier  report.  The  subjects'  military  ex¬ 
perience  in  electronics  or  electrical  work  averaged  11.2  years.  They  had  been 
AT's  for  an  average  of  8.  3  years  and  had  been  assigned  as  an  AT  to  an  average  of 
3.  8  squadrons. 

Administration 

Form  C  of  the  Technical  Task  Inventory  was  administered  to  the  subjects 
in  the  same  group  sessions  as  Form  S  of  the  Inventory  used  in  the  earlier  study. 
Form  C  was  completed  first,  followed  by  Form  S.  The  last  booklet  the  subjects 
completed  was  the  Technical  Circuit  Inventory,  another  multidimensional  scaling 
form  employing  equipment  as  stimuli  rather  than  tasks.  The  analysis  of  this 
third  form  will  be  presented  in  a  later  report. 

A  brief,  general  description  of  the  research  project  was  given  by  the 
administrator  at  the  beginning  of  the  session.  A  short  break  was  permitted  after 
the  second  form  was  completed.  A  few  biographical  facts  were  requested  on  a 
sheet  given  the  subjects  after  the  break.  No  time  limits  were  imposed,  but  almoi 
all  the  subjects  completed  the  three  booklets  before  the  end  of  the  scheduled  three 
hours. 
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Table  4 


Numbers  of  Subjects  by  Location  and  Squadron 


Location 

Squadron 

Number 

Norfolk 

PAETULANT 

29 

HS  3 

2 

HS  7 

2 

VP  24 

2 

VP  56 

3 

VRC  40 

2 

VRF  31 

1 

VS  26 

2 

VU  6 

3 

Oceana 

VA  42 

2 

VA  43 

10 

VA  75 

1 

VF  101  Det.  A 

5 

VU  2 

1 

65 
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As  mentioned  in  the  previous  report  no  difficulty  was  encountered  in 
achieving  understanding  by  the  subjects  of  what  they  were  to  do.  Almost  no  ex¬ 
planation  was  required  outside  of  the  directions  on  the  booklets;  thus  the  forms 
were  essentially  self-administering. 

Although  the  supervisors  were  able  to  accomplish  the  rating  easily,  severs 
of  them  said  informally  that  they  did  not  see  what  specific  purposes  analysis  of  th< 
data  would  serve.  Some  also  mentioned  that  their  concept  of  the  similarity  scale 
might  have  been  altered  as  they  worked  through  the  first  form,  the  analysis  of 
which  is  reported  here. 


CHAPTER  III 


THE  MULTIDIMENSIONAL  SCAUNG  ANALYSIS 

In  multidimensional  scaling  analysis,  the  scaled  values  associated  with  the 
subjects'  similarity  estimates  are  viewed  as  measures  of  the  psychological  dis¬ 
tances  between  the  stimulus  pairs.  In  this  study,  the  category  widths  on  the  simi¬ 
larity  scale  used  were  not  explicitly  stated  for  the  judges  either  in  the  directions 
for  the  Technical  Task  Inventory  or  in  the  labeling  of  the  scale  itself.  However, 
it  seemed  reasonable  to  assume  that  the  judges  perceived  the  scale  category 
widths  as  equal;  this  assumption  considerably  simplified  the  required  computations 
and  probably  introduced  no  gross  distortions  into  the  dimensional  structure. 

Under  the  assumption  of  equal  category  widths,  it  was  possible  to  use  the 
method  of  equal  appearing  intervals  to  obtain  the  inter-task  distances.  In  this 
method  the  median  judgment  on  the  scale  is  taken  as  the  scale  value  of  the  stimulus. 
In  the  present  application,  the  median  judgment  on  the  similarity  scale  with  regard 
to  each  task  pair  was  calculated  to  be  the  scale  value  for  that  pair;  the  scale  value, 
i.  e. ,  the  median,  was  then  viewed  as  the  relative  psychological  distance  between 
those  two  tasks.  For  each  of  the  406  task  pairs  of  Form  C  of  the  Technical  Task 
Inventory,  the  median  of  the  65  values  checked  by  the  subjects  is  presented  in 
Table  5. 
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4.58  3.21  4.37  1,  S7  8.17  4.15  4.23 


The  Reliability  of  the  Inter-Task  Distance  Estimates 


There  have  been  only  a  few  reports  of  the  reliability  of  the  distance  judg¬ 
ments  in  multidimensional  scaling.  Using  successive  intervals  procedures  with 
20  colors  as  stimuli.  Helm  (1960)  ran  one  subject  through  the  experiment  a 
second  time  after  an  interval  of  three  weeks.  The  product- moment  correlation 
coefficient  between  the  two  sets  of  judgments  was  .87.  In  addition,  as  a  standard 
part  of  Helm's  experimental  procedure,  after  all  the  stimulus  pairs  had  been 
reacted  to  once,  the  first  20  pairs  were  immediately  readministered.  Helm  re¬ 
ported  that  marked  changes  in  scale  value  assignments  were  rare.  Also,  he  used 
a  warm-up  of  10  or  so  repeated  estimates  if  part  of  the  experiment  was  completed 
on  a  second  day,  with  little  change  occurring  in  category  placement  of  the  colors. 

The  issue  of  whether  the  inter -stimulus  distance  as  judged  from  stimulus 
A  to  stimulus  B  is  the  same  as  the  distance  as  judged  from  B  to  A  involves  not 
only  judgment  reliability  but  also  the  question  of  whether  the  data  fit  the  require¬ 
ments  of  a  Euclidean  space  model.  Messick  (1956a)  and  Schultz  and  Siegel  (1962) 
found  that  this  non-directional  characteristic  was  present  in  their  data,  implying 
both  judgment  reliability  and  the  presence  of  a  model  requirement. 

As  mentioned  above.  Form  C  of  the  Technical  Task  Inventory,  used  in  the 
study  described  here,  had  nine  items  also  appearing  in  Form  S,  which  applied  to 
the  striker's  job.  It  was  possible,  therefore,  to  compare  the  scale  values  for  the 
distances  among  these  nine  items,  first  as  derived  from  Form  C  and  second  as 
derived  from  Form  S.  In  Form  S  both  the  A-to-B  and  B-to-A  judgments  were 
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made;  the  one  which  matched  that  included  in  Form  C  was  used  for  the  reliability 
determination. 

The  means  and  standard  deviations  of  the  36  distance  estimates  among 
these  nine  stimuli  are  presented  in  Table  6.  In  general,  the  scale  values  are  dis¬ 
placed  upward  (toward  the  "different"  end  of  the  scale)  and  are  slightly  less 
scattered  when  the  distances  are  estimated  for  a  second  time.  However,  the 
correlation  coefficient  between  the  two  sets  of  scale  values  is  .  94.  It  would  appea; 
therefore,  that  the  ranking  of  the  distance  judgments  remained  the  same  but  that 
the  entire  reference  scale  shifted  as  the  men  worked  through  more  ratings.  When 
these  findings  are  tied  in  with  the  facts  that  (1)  some  of  the  men  said  they  thought 
this  had  happened  to  them  and  (2)  the  A-to-B  and  B-to-A  estimates  derived  from 
Form  S  (the  second  form  administered)  were  almost  identical,  there  is  a  strong 
suggestion  that  it  takes  the  judges  a  while  to  settle  the  type  of  judgment  here  in¬ 
volved  into  a  stable  frame  of  reference.  To  eliminate  any  distortions  introduced 
by  this  tendency,  it  would  probably  be  wise,  whenever  possible,  to  give  the  judges 
a  number  of  practice  trials  before  they  are  asked  to  make  ratings  which  are  used 
in  analyses.  It  will  be  recalled  that  two  practice  ratings  were  provided  on  the 
cover  page  of  Form  C  of  the  Technical  Task  Inventory;  apparently  more  than  this 
number  are  required.  Also,  since  four  random  page  arrangements  were  employe 
a  particular  task  pair  appeared  in  different  parts  of  the  booklet  for  various  subjec 
subgroups.  Any  pronounced  effect  resulting  from  an  item's  position  should  thus 
have  been  minimized  when  all  the  subjects  were  pooled  for  the  analysis.  The 
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results  discussed  above  appeared  in  spite  of  this  precaution.  The  varied  page 
arrangement  had  also  been  used  with  Form  S  of  the  Technical  Task  Inventory,  to 
reduce  the  position  effect. 


Table  6 

Means  and  Standard  Deviations  of  Inter-Task  Distances  Judged  on  Two 

Different  Forms  of  the  Technical  Task  Inventory 

at  the  Same  Administration 

Form  C 

Form  S 

(N  =  36 ) 

(N  =  36) 

Mean 

5.  51 

6.  18 

S.D. 

2.46 

2.29 

It  should  be  mentioned  that  the  determination  of  the  proper  additive  con¬ 
stant  to  set  the  obtained  scale  values  on  a  ratio  scale  will,  to  some  extent,  correc' 
for  the  problem  discussed  here.  However,  if  the  reference  scale  is  actually 
shifting  from  one  rating  to  the  next,  this  adjustment  procedure  cannot  be  expected 
to  take  care  of  the  difficulty  entirely. 

The  Dimensionality  Analysis 

Starting  with  the  scaled  inter-task  distances  shown  in  Table  5,  the  usual 
multidimensional  scaling  procedures  were  followed.  First,  the  Messick-Abelson 
(1956)  general  solution  to  the  additive  constant  problem  was  applied  to  the  data  in 
order  to  obtain  a  value  which  could  be  added  to  the  original  scaled  distances  in 
order  to  achieve  a  ratio,  rather  than  merely  an  interval,  scale  as  required  by  the 
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analytical  model.  This  constant  was  found  to  be  +  3. 10.  The  smallest  judged  dis*^ 
tance  in  Table  5  is  0.  67;  accordingly  the  smallest  corrected  inter-task  difference 
became  +  3.  77. 

The  matrix  of  corrected  scale  values  was  converted  to  a  matrix,  B*  ,  of 
scalar  products  of  the  vectors  to  points  with  an  origin  at  the  centroid  of  the  stimuli 
The  B*  matrix  is  given  in  Appendix  A  of  this  report. 

The  B*  matrix  was  factored  by  the  method  of  principal  components  to  pro¬ 
duce  the  matrix,  F  ,  presented  in  Appendix  B.  The  rank  of  matrix  F  is  nine. 

The  matrix  of  residuals,  after  extraction  of  the  nine  dimensions  from  the  matrix 
B*  is  given  in  Appendix  C. 

The  nine  axes  of  matrix  f  were  rotated  to  orthogonal,  simple  structure 
as  tested  by  the  normal  equamax  criterion,  an  analytical  solution  to  the  rotation 
problem  developed  by  Saunders  (1962).  The  transformation  matrix  is  presented 
in  Table  7  and  the  final  matrix  of  projections  of  the  stimuli  (tasks)  on  the  rotated 
axes  is  presented  in  Table  8. 

Interpretation  of  Dimensions 

Dimension  I.  The  tasks  with  the  highest  projections  (loadings)  on  the  first 
dimension  are  shown  in  Table  9.  The  positive  end  of  this  dimension  appears  to 
involve  the  maintenance  and  troubleshooting  of  avionic  equipments,  while  the 
negative  end  involves  the  routine  use  of  reference  materials  and  record  keeping. 
Since  the  positive  direction  calls  for  problem  solving  as  related  to  the  diagnosis  o 
malfunctions  in  electronic  equipment  and  the  maintenance  of  electronic  equipment, 
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Table  8 


Final  Matrix  of  Projections  of  Tasks  on  Dimensions 


Dimension  Number 


Task  No. 

I 

a 

ni 

IV 

V 

VI 

VII 

Via 

1 

0.64 

4.01 

-  1.47 

-  0.44 

0.  10 

-  0.  76 

-  0.  27 

0.  12 

2 

0.  30 

1.09 

-  0.86 

0.09 

0.28 

-  4.  58 

-  1.52 

0.  18 

3 

0.03 

1.  30 

-  0.95 

0.  37 

0.97 

-  4.  38 

*  1.  37 

-  0.  31 

4 

-  5.  40 

1.06 

-  2.34 

1.  35 

2.98 

2.29 

4.  27 

-  2.02 

5 

-  2.46 

0.20 

0.50 

1.26 

2.68 

-  0.  54 

0.51 

-  3.  36 

6 

0.05 

-  7.  30 

-  2.99 

-  4.71 

-  1.61 

3.00 

2.  43 

1. 60 

7 

-  0.02 

-  1,  33 

3.41 

*  0.  09 

-  2.00 

1.  27 

-  1.08 

-  0.  61 

8 

0.85 

0.56 

1.10 

-  0.  29 

-  0.  33 

0.  43 

-  0.05 

-  3.22 

9 

0.  20 

0,42 

1.25 

-  5.50 

-  0.08 

0.  20 

-  0.  16 

-  0.  89 

10 

4.42 

1.41 

-  0.  29 

-  0.  26 

0.64 

0.  72 

-  0.53 

-  2.00 

a 

0.21 

1.26 

2.27 

0.  35 

-  0.49 

0.  17 

-  0.  35 

3.  56 

12 

0.78 

0.86 

0.61 

-  0.53 

0.94 

-  0.93 

-  3.  77 

-  0.  18 

13 

2.47 

2.  38 

-  0.04 

0.28 

-  0.83 

-  1.  80 

-  0.55 

0.  49 

14 

-  0.66 

-  0.59 

2.99 

-  0.  30 

-  0.60 

-  0.05 

0.  30 

1.52 

15 

0.02 

-  0.68 

4.93 

-  1.04 

0.  20 

1. 04 

-  0.  35 

-  0.  31 

16 

0.  30 

0.94 

0.01 

0.40 

-  0.02 

-  1.24 

-  4.75 

0.  71 

17 

-  4.88 

-  2.07 

-  4.69 

1.  10 

2.36 

3.  37 

1, 87 

2.73 

18 

-  0.52 

-  0.00 

-  0.  71 

1.59 

4.43 

-  0.  28 

0.97 

0.48 

18 

1.  12 

-  0.  74 

1.92 

-  1.  32 

0.01 

2.  38 

*  3.64 

•  1.89 

20 

1.08 

-  1.  33 

0.63 

-  5.  11 

-  0.48 

0.  63 

-  0.  32 

0.  40 

21 

-  0.  34 

0.  37 

-  0.00 

-  0.01 

-  3.40 

0.78 

1.44 

1. 50 

22 

-  0.52 

‘  1.58 

1.01 

0.03 

-  2.  32 

-  0.03 

1.  32 

0.21 

23 

2.81 

1.97 

•  1.44 

1.  34 

0.26 

-  0.  81 

-  1.52 

0.  99 

24 

-  1.22 

•  4.58 

0.24 

0.99 

-  6.57 

1.04 

3.73 

0.23 

25 

0.85 

1.52 

-  0.  36 

1.08 

1.72 

>  2.63 

1.  31 

0.50 

26 

0.  36 

0.42 

-  0.93 

-  0.  12 

0.79 

0.53 

-  0.  15 

-  0.92 

27 

-  5.  12 

0.22 

-  4.71 

3.  14 

•  1.55 

3.80 

1.76 

-  0.71 

28 

1.63 

0.96 

0.51 

2.  35 

0.43 

-  3.35 

•  0.04 

1.25 

29 

3.04 

-  0.  73 

0.40 

3.98 

1.49 

•  0.28 

0.49 

•  0.04 

25 


Table  9 


Tasks  with  Highest  Projections  on  Dimension  I 


Task  No. 

Loading 

Task 

10 

-t-  4.  42 

Performing  inflight  maintenance  on  avionic 
equipments 

29 

+  3.  04 

Following  block  diagrams  for  avionic  equipments 

23 

+  2.  81 

Troubleshooting/ isolating  malfunctions  in  avioni< 
equipments 

13 

+  2,47 

Employing  electronic  principles  involved  in  the 
maintenance  of  avionic  equipments 

5 

-  2.46 

Using  inspection  and  operation  manuals 

17 

-  4.88 

Making  out  reports  (failure^  etc.  ) 

27 

-  5.  12 

Keeping  record  of  maintenance  usage  data 

4 

-  5.40 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 
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the  name  assigned  to  this  dimension  is  *^electro*cognition,  " 


Dimension  11.  The  two  tasks  with  the  highest  positive  loadings  on  this 
dimension,  as  seen  in  Table  10,  relate  to  aspects  of  equipment  repair  in  the  shop. 
Since  shop  work  represents  the  central  and  most  complex  repair  process,  this 
dimension  is  designated  ^*electro-repair  (complex)”  to  differentiate  it  from  the 
”electro-repair  (simple)^*  dimension  extracted  in  the  journeyman  level  study. 

Dimension  111.  Three  of  the  four  tasks  with  positive  loadings  in  Table  1 1 
involve  instructional  activities.  There  is  little  doubt  that  the  third  dimension  is 
"instruction.  " 

Dimension  IV.  Table  12  presents  the  tasks  with  the  highest  loadings  on 
the  fourth  dimension.  Although  the  positive  direction  on  the  dimension  involves 
some  kind  of  ability  in  understanding  diagrams  and  circuitry,  the  precise  nature 
of  that  portion  of  the  axis  is  not  very  clear.  The  negative  direction  obviously  is 
a  safety  factor.  This  dimension  is  called  "electro-safety.  " 

Dimension  V.  The  tasks  with  negative  loadings  listed  in  Table  1 3  provide 
the  basis  for  naming  this  dimension.  These  four  tasks  are  all  essentially  the 
management  of  personnel  involved  in  serving  in  a  maintenance  capacity.  There¬ 
fore,  the  name  "personnel  relationships"  was  chosen  for  the  fifth  dimension. 

Dimension  VI.  The  group  of  tasks  associated  with  negatively  oriented 
loadings  presented  in  Table  14  suggest  that  dimension  VI  relates  to  the  under¬ 
standing  of  the  principles  of  electronic  circuitry.  The  tasks  with  the  high  positive 
loadings  are  generally  more  simple,  routine  duties.  This  dimension  is  assumed 
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Table  10 


Tasks  with  Highest  Projections  on  Dimension  II 


Task  No. 

Loading 

Task 

1 

+  4.01 

Repairing  malfunctioning  parts /equipment  in 
shop 

13 

+  2.  38 

Employing  electronic  principles  involved  in  the 
maintenance  of  avionic  equipments 

17 

-  2.07 

Making  out  reports  (failure,  etc. ) 

24 

-  4.58 

Assigning  duties  to  personnel 

6 

-  7.  30 

Standing  watch 
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Table  11 


Tasks  with  Highest  Projections  on  Dimension  III 


Task  No. 

Loading 

Task 

15 

+  4.93 

Instructing  others  in  the  operation  of  avionic 
equipments 

7 

+  3.41 

Supervising  operation  of  avionic  equipments 

14 

2.99 

Instructing  others  in  the  inspection  of  avionic 
equipments 

11 

+  2.27 

Instructing  others  in  the  maintenance  of  avionic 
equipments 

4 

-  2.34 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

6 

-  2.99 

Standing  watch 

17 

-  4.69 

Making  out  reports  (failure,  etc. ) 

27 

-  4.71 

Keeping  record  of  maintenance  usage  data 
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Table  12 


Tasks  with  Highest  Projections  on  Dimension  IV 


Task  No. 

Loading 

Task 

29 

-t-  3.98 

Following  block  diagrams  for  avionic  equipments 

27 

+  3. 14 

Keeping  record  of  maintenance  usage  data 

28 

+  2.  35 

Analyzing  standard  circuitry  in  avionic  equip* 
ments 

6 

-  4.71 

Standing  watch 

20 

-  5.  11 

Using  proper  safety  precautions  for  self 

9 

-  5.50 

Using  safety  precautions  on  equipment 
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I 


Table  13 

Tasks  with  Highest  Projections  on  Dimension  V 


1 

Task  No. 

Loading 

Task 

1 

18 

-1-  4.43 

Using  maintenance  manuals 

4 

+  2.  98 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

( 

5 

+  2.68 

Using  inspection  and  operation  manuals 

M 

i 

[ 

+  2.36 

Making  out  reports  (failure,  etc. ) 

f 

\ 

e 

[ 

7 

-  2.00 

Supervising  operation  of  avionic  equipments 

[  22 

-  2.32 

Supervising  inspection  of  avionic  equipments 

1 

r  21 

-  3.40 

Supervising  maintenance  of  avionic  equipments 

IL 

24 

-  6.57 

Assigning  duties  to  personnel 

Table  14 


Tasks  with  Highest  Projections  on  Dimension  VI 

Task  No. 

Loading 

Task 

27 

+  3.  80 

Keeping  record  of  maintenance  usage  data 

17 

+  3.  37 

Making  out  reports  (failure,  etc. ) 

6 

+  3.00 

Standing  watch 

19 

+  2.  38 

Operating  avionic  equipments 

4 

+  2.29 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

25 

-  2.  63 

Using  schematics  for  standard  circuits  in  avionic 
equipments 

28 

-  3.35 

Analyzing  standard  circuitry  in  avionic  equipmenti 

3 

-  4.  38 

Using  schematics  for  complex  circuits  in  avionic 
equipments 

2 

-  4.58 

Analyzing  complex  circuitry  in  avionic  equipments 

to  be  the  ^'electro-comprehension**  dimension  found  in  the  study  of  striker  and 
third  class  AT's.  An  alternate  name  in  both  studies  could  be  "electronic  circuit 
analysis.  " 

Dimension  VII.  Table  15  contains  the  six  tasks  with  the  highest  loadings  on 
the  seventh  dimension  extracted.  The  thread  running  through  the  three  tasks  with 
negative  values  is  clearly  operating  various  equipment  and  the  highest  loading  is 
associated  with  the  operation  of  more  complex  equipment.  Therefore,  this  dimen¬ 
sion  is  labeled  "equipment  operation  (complex).  *' 

Dimension  Vlll,  Although  this  dimension  does  not  appear  to  be  as  clear  as 
the  others,  in  terms  of  the  task  loadings  presented  in  Table  16,  the  negative 
orientation  of  the  axis  seems  to  involve  the  use  of  supporting  reference  materials. 
This  dimension  is,  therefore,  tentatively  named  "using  reference  materials.  " 
Dimension  DC.  As  can  be  seen  from  the  tasks  listed  in  Table  17,  the 
negative  direction  of  this  dimension  relates  to  various  aspects  of  inspecting  avionh 
equipment.  The  emphasis  here  seems  to  be  on  the  more  important  inspection 
activities,  rather  than  on  the  simpler,  more  routine  inspections.  As  a  result,  the 
name  selected  for  this  dimension  is  "equipment  inspection  (complex).  " 

Comparison  of  Two  Job  Levels  within  the  Aviation 
Electronics  Technician  Rating 

Since  the  previous  study  by  Schultz  and  Siegel  (1962)  extracted  the  factors 
of  the  aviation  electronic  technician  job  at  the  level  of  strikers  and  petty  officers, 
third  class,  a  comparison  can  now  be  made  between  the  journeyman  level  and  the 
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Tasks  with 


24  +3.73 

}'  6  +2.43 


-  3.64 

-  3.77 

-  4.75 


Table  15 


ighest  Projections  on  Dimension  VII 

Task 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

Assigning  duties  to  personnel 

Standing  watch 

Operating  avionic  equipments 

Operating  standard  test  equipment  for  deter* 
mining  malfunctions  in  avionic  equipments 

Operating  specialized  test  equipment  for  deter¬ 
mining  malfunctions  in  avionic  equipments 
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Tasks  with  Highest  Projections  on  Dimension  VIII 


Loading 
+  3.56 

+  2.73 

-  2.02 

-  3.22 

-  3.36 


Task 

Instructing  others  in  the  maintenance  of  avionic 
equipments 

Making  out  reports  (failure,  etc. ) 


Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

Knowing  relationship  of  avionic  equipments  to 
other  related  equipment 

Using  inspection  and  operation  manuals 


Table  17 


Tasks  with  Highest  Projections  on  Dimension  IX 


Task  No. 

Loading 

Task 

4 

+  3.48 

Using  ASO  catalog  and  Section  R  allowance  list 
for  replacement  parts 

22 

-  2.93 

Supervising  inspection  of  avionic  equipments 

14 

-  3.43 

Instructing  others  in  the  inspection  of  avionic 
equipments 

26 

-  4.46 

Performing  major  inspections  of  avionic  equip¬ 
ments 
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supervisory  level  AT  job  in  terms  of  the  underlying  dimensions  seen  by  the  super¬ 
visors  as  constituting  each  job. 

Nine  meaningful  dimensions  resulted  from  the  examination  of  the  chief 
petty  officer’s  job,  while  only  four  were  found  in  the  study  of  strikers.  Thus,  it 
can  be  concluded  that  the  supervisory  personnel's  job  is  based  on  a  more  hetero¬ 
geneous  substrate  than  is  that  of  the  striker.  This  is  not  merely  a  matter  of  per¬ 
forming  more  tasks  within  the  same  dimensional  framework  but  of  serving  more 
functions  of  a  basically  different  kind.  The  additional  performance  dimensions  of 
the  chief  petty  officer’s  job  are  electro- cognition  (maintenance-troubleshooting), 
instruction,  personnel  relationships,  and  using  reference  materials. 

The  four  job  dimensions  at  the  journeyman  level  are  also  present  at  the 
higher  level.  Electro-comprehension  and  electro- safety  appear  to  be  essentially 
similiar  in  character  in  each  case.  But  as  one  moves  from  the  lower  to  the  higher 
level  job,  routine  equipment  operation  and  inspection  breaks  into  two  independent 
dimensions,  each  involving  more  complex  requirements.  For  example,  the 
inspection  portion  of  the  strikers'  dimension  is  characterized  by  the  performance 
of  preflight  and  postflight  inspections  of  avionic  equipment,  while  the  chief  petty 
officers’  dimension  is  characterized  by  the  performance  of  major  inspections. 

In  addition,  the  electro-repair  dimension  differs  in  complexity  at  the  two  job 
levels.  For  the  striker  it  consists  primarily  of  removing  malfunctioning  parts 
and  equipment  from  planes  and  replacing  them  after  repair;  for  the  chief  petty 
officer,  on  the  other  hand,  this  dimension  refers  to  repair  work  on  malfunctioning 
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parts  and  equipment  in  the  shop,  involving  knowledge  of  appropriate  electronic 
principles. 

Thus,  in  general,  the  job  of  chief  petty  officer  and  petty  officer,  first 
class,  in  the  aviation  electronics  technician  rating  is  seen  by  the  supervisors,  on 
the  basis  of  this  research,  to  encompass  all  the  activities  that  are  performed  by 
strikers  and  petty  officers,  third  class,  in  the  rating  but  at  a  more  complex  level 
and,  in  addition,  to  include  several  functions  which  are  not  performed  by  strikers. 

Discussion 

The  dimensional  organization  of  the  AT  rating  defined  by  the  results  of  the 
present  research  seems  reasonable,  both  in  its  own  right  and  in  comparison  with 
the  results  of  the  journeyman  level  study.  The  nine  dimensions  describe  obviously 
important  parts  of  the  AT  supervisory  job.  Men  at  the  chief  petty  officer  level 
should  know  the  basic  technical  skills  such  as  operation,  inspection,  and  repair, 
yet  have  a  deeper  understanding  of  the  basic  principles  and  possess  a  higher  skill 
level  than  would  be  expected  of  a  less  experienced  technician.  In  addition,  it  is 
apparent  that  a  supervisor  is  called  upon  to  instruct  and  serve  other  functions  in¬ 
volving  personnel  relationships. 

The  characteristics  of  the  dimensions  extracted  appear  to  lend  themselves 
to  the  construction  of  unidimensionally  scaled  instruments  for  measuring  each 
dimension  separately.  Since  several  of  the  dimensions  represent  higher  levels  of 
factors  also  present  in  the  striker  and  petty  officer,  third  class,  AT  job,  it  may 
be  possible  to  develop  single  scales  in  these  cases  to  cover  the  whole  range  of 
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activities  encompassing  the  two  job  levels.  In  electro- safety,  there  are  probably 
minor  differences  between  the  two  job  levels,  so  the  same  unidimensional  scale 
would  be  applicable.  A  methodology  for  constructing  job  task  performance 
instruments  which  meet  the  Thurstone  and/or  Guttman  scalability  requirements  is 
available  from  previous  research  (Schultz  and  Siegel,  1961;  Siegel  and  Schultz, 
1962). 

It  might  be  argued  that,  for  purposes  of  evaluating  the  job  performance  of 
individual  chief  petty  officers,  the  perceptions  of  their  superiors,  i.  e. ,  com¬ 
missioned  officers  or  warrant  officers,  should  be  analyzed  as  the  basis  for 
selecting  the  dimensions  along  which  the  evaluations  should  be  made.  However, 
good  personnel  practice  would  suggest  acceptance  of  the  job  criterion  by  both  the 
worker- -in  this  case,  the  chief  petty  officer- -and  his  superior- -the  commissionec 
officer  or  the  warrant  officer.  Acceptance  will  very  likely  be  enhanced  if  both 
parties  perceive  the  job  as  involving  the  same  dimensions.  Thus,  the  current  stu 
may  be  viewed,  in  part,  as  one  step  in  the  development  of  evaluative  instruments 
for  non-commissioned  AT  supervisors. 

Two  important  points  regarding  multidimensional  scaling  procedures  shou 
be  kept  in  mind  in  evaluating  findings  resulting  from  their  application.  First,  the 
outcomes,  i.  e. ,  the  dimensions,  are  initially  determined  by  the  form  and  adequa 
of  the  input  data.  In  the  present  investigation  the  goal  was  to  provide  the  judges 
with  a  group  of  tasks  that  would  include  all  the  important  work  activities  of  aviatic 
electronics  technicians  at  the  chief  petty  officer  and  petty  officer,  first  class,  lev 
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As  a  result,  the  dimensions  are  defined  in  terms  of  work  activities,  rather  than 
other  possible  types  of  input  information,  such  as  equipment  used,  equipment 
worked  on,  or  worker*  requirements. 

Second,  the  cUarity  and  validity  of  the  resultant  dimensional  structure  in 
some  instances  may  cSepend  upon  the  appropriateness  of  certain  decisions  about 
technical  matters  whi  ch  are  made  as  the  analysis  is  proceeding.  The  choice  of 
method  used  to  scale  the  stimulus  pair  judgments  and  the  issue  of  the  advisability 
of  a  transformation  olE  the  scaled  inter-stimulus  distances  (Helm,  Messick,  and 
Tucker,  1961)  are  twcz)  examples  of  such  matters  which  have  been  previously 
mentioned. 

In  both  the  ear*lier  study  of  the  striker's  job  and  in  the  current  study, 
several  dimensional  aspaces  appeared  to  fit  the  data  reasonably  well  from  the 
psychometric  viewpoi^it.  In  the  report  of  the  first  study  (Schultz  and  Siegel,  1962) 
it  was  mentioned  that  application  of  the  Messick-Abelson  solution  for  the  additive 
constant  led  initially  to  eight,  instead  of  the  eventually  chosen  four  dimensions. 

In  the  present  work,  m.n  addition  to  the  analysis  described  here,  a  four  dimensional 
solution  was  arbitrart-ly  imposed  on  the  data.  The  resultant  dimensionality 
appeared  to  possess  {Psychometric  consistency  and  reasonableness.  In  both  studies 
the  ultimate  criterion  used  in  selecting  a  final  solution  was  the  over-all  meaning¬ 
fulness,  precision,  amd  clarity  of  the  dimensions  extracted,  as  manifested  in  the 
tasks  with  the  highest  loadings  on  the  dimensions.  In  each  study,  however,  a 
solution  involving  a  different  number  of  dimensions  could  have  been  justified  on  the 
basis  of  the  empiricaB.  data  and  would  have  produced  defensible  conclusions. 
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CHAPTER  IV 


SUMMARY  AND  CONCLUSIONS 


Summary 

The  study  described  in  this  report  represents  a  second  application  of  multi 
dimensional  scaling  methods  in  the  area  of  job  performance  criterion  development 
The  results  of  the  first  application  of  the  methods  to  job  related  stimuli  (Schultz 
and  Siegel,  1962)  suggested  that  the  job  performance  of  Naval  aviation  electronics 
technicians  at  the  striker  and  petty  officer,  third  class,  level  comprised  four  basi< 
dimensions.  Since  a  contention  that  multidimensional  scaling  can  be  useful  for 
analyzing  a  job  task  constellation  was  supported,  it  seemed  desirable  to  carry  out 
a  further  study,  this  time  applying  the  techniques,  for  comparative  purposes,  at 
a  different  job  level. 

The  objectives  of  this  study,  therefore,  paralleled  those  of  the  earlier 
program.  They  were  to;  (1)  explore  further  the  feasibility  of  applying  standard 
multidimensional  scaling  procedures  to  a  job  task  constellation,  (2)  investigate 
more  fully  specific  methods  for  applying  these  techniques  in  the  work  oriented 
situation,  (3)  determine  the  number  and  the  nature  of  the  dimensions  of  the  job 
of  the  Naval  aviation  electronics  technician  (AT)  supervisor,  and  (4)  compare 
the  dimensional  structure  of  the  aviation  electronics  technician's  job  at  the 
supervisory  level  with  that  of  the  same  rating  at  the  journeyman  level. 

The  procedures  followed  in  the  present  work  were  very  similar  to  those  of 
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the  previous  investigation.  The  same  subjects  were  involved  and  there  was  com- 
munality  among  the  forms  used.  Initially  a  list  of  tasks  which  were  thought  to 
include  all  the  job  activities  typically  performed  by  Naval  aviation  electronics 
technicians  was  submitted  to  a  group  of  men  experienced  in  the  rating.  It  was  the 
consensus  of  this  group  that  29  of  the  listed  tasks  constituted  the  job  of  chief  petty 
officer  and  petty  officer,  first  class.  Of  the  29  tasks,  9  were  also  included  in  the 
group  comprising  the  striker's  job,  as  revealed  in  the  previous  study.  A  number 
of  the  simpler  tasks  were  designated  as  being  done  only  by  strikers  and  the 
generally  more  complex  tasks  only  by  chief  petty  officers. 

A  booklet  was  prepared,  so  that  all  possible  pairs  of  the  29  tasks  could  be 
rated  along  an  eleven-point  similarity  scale.  The  analysis,  by  the  method  of 
equal  appearing  intervals,  of  the  data  resulting  from  administration  of  this  bookie' 
to  a  group  of  chief  and  first  class  petty  officers  in  the  AT  rating  produced  scale 
values  for  the  task  pairs. 

Taking  the  scale  value  for  each  task  pair  as  the  psychological  distance 
between  that  pair,  multidimensional  procedures  that  have  been  frequently  used 
were  followed.  The  Messick-Abelson  solution  to  the  additive  constant  problem  wa 
first  applied,  in  order  to  obtain  a  value  which  could  be  added  to  the  scaled  distance 
so  that  they  could  refer  to  a  true  zero  point.  A  matrix  of  scalar  products  was  thei 
computed  from  the  corrected  scale  values  and  factored  by  the  method  of  principal 
components.  The  factor  matrix  was  rotated  to  orthogonal  simple  structure  accorc 
ing  to  the  equamax  criterion. 
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A  spatial  structure  of  nine  dimensions  was  determined  as  underlying  the 
distance  system  defined  by  the  inter -task  data.  The  nine  dimensions  were  named 
"electro-cognition,  "  "electro-repair  (complex),  "  "instruction,  "  "electro- safety,  " 
"personnel  relationships,  "  '  'e  lectro  -  comprehension,  "  "equipment  operation 
(complex),  "  "using  reference  materials,  "  and  "equipment  inspection  (complex).  " 

It  was  pointed  out  that  all  four  dimensions  found  in  the  earlier  analysis  of  the  AT 
striker's  job  were  represented  among  these  nine  dimensions.  Two  of  the  common 
dimensions  were  essentially  similar  at  the  two  job  levels,  while  the  other  two  were 
characterized  by  more  complex  activities  at  the  supervisory  level.  In  addition,  thi 
chief  petty  officer's  job  includes  several  functions  not  performed  by  strikers. 

In  view  of  several  technical  problems  that  are  involved,  the  results  of  both 
the  current  study  and  the  earlier  study  should  be  looked  upon  as  subject  to  further 
verification,  refinement,  and  clarification.  Nevertheless,  the  general  picture  of 
the  two  job  levels  in  the  AT  rating  that  they  define  appears  to  be  reasonable  and 
useful.  In  particular,  the  characteristics  of  the  extracted  dimensions  would  appea 
to  make  it  possible  to  develop  unidimensional,  scaled  criterion  instruments  for  the 
separate  dimensions.  Sucli  measures  could  be  applied  in  the  evaluation  of  the  job 
performance  of  individuals  in  each  of  the  independent  kinds  of  job  performance 
behavior. 

Conclusions 

Further  evidence  is  provided  by  the  results  of  the  research  described  in 
this  report  that  it  is  feasible  and  fruitful  to  apply  multidimensional  scaling 
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techniques  to  Naval  job  performance.  The  methods  developed  generate  the  appro* 
priate  basic  data  required  by  the  multidimensional  models. 

The  following  conclusions  are  Indicated  with  regard  to  the  specific  job 


studied: 


1.  The  work  performed  by  chief  petty  officer  and  petty 
officer,  first  class,  aviation  electronics  technicians 
is  perceived  by  men  at  that  level  in  the  rating  as  in¬ 
volving  nine  basic  dimensions.  The  dimensions  are 
tentatively  named  ^^electro-cognition,  ^electro-repair 
(complex),  "  'instruction,  "  *'electro-safety,  "  ’’personnel 
relationships,  "  ’'electro^coinprehension,  ^  "equipment 
operation  (complex),  "  '^^using  referent mat^ials,  "  and 
equipment  inspection  (complex). 

2.  The  characteristics  of  the  nine  extracted  dimensions 
would  appear  to  make  it  possible  to  develop  unidimensional 
scales  for  the  evaluation  of  individual  technicians  on  each 
dimension. 

3.  The  job  of  chief  petty  officer  and  petty  officer,  first  class, 
in  the  aviation  electronics  technician  rating  encompasses 
all  four  of  the  basic  dimensions  that  are  represented  in 
the  striker  and  petty  officer,  third  class,  job.  However, 
the  supervisory  personnel  perform  at  a  generally  more 
complex  level  and,  in  addition  serve  several  functions 
which  are  not  engaged  in  by  the  journeyman  level  per¬ 
sonnel. 
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APPENDIX  A 

Appendix  A  presents  the  matrix  B* 
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Matrix  g*  ot  Scalar  ProdttcU  with  Origin  at  Centroid  of  Stimuli  (Con*t. ) 
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Matrix  ^  of  Scalar  Products  with  Origin  at  Centroid  of  Stimuli  (Con*t.  ) 
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Appendix  B  presents  the  matrix  F 
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Appendix  C  presents  the  matrix  of  residuals  after 
extraction  of  nine  dimensions  from  matrix  B* 


The  Residual  Matrix  after  Extractioi?  of  Nine  Dimensions  from  the  Matrix  8* 
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